MobileLLM-Pro is a 1-billion-parameter efficient device-side language model launched by Meta, optimized for mobile devices, supporting a context length of 128k and providing high-quality inference capabilities. This model is trained using knowledge distillation technology, outperforming models of the same scale in multiple benchmark tests, and supporting nearly lossless 4-bit quantization.
Natural Language Processing
TransformersEnglish